Papers with linear mapping method
Multimodal Cross-Document Event Coreference Resolution Using Linear Semantic Transfer and Mixed-Modality Ensembles (2024.lrec-main)
Copied to clipboard
Abhijnan Nath, Huma Jamil, Shafiuddin Rehan Ahmed, George Arthur Baker, Rahul Ghosh, James H. Martin, Nathaniel Blanchard, Nikhil Krishnaswamy
| Challenge: | Existing methods for cross-document coreference resolution do not provide images for all mentions of events. |
| Approach: | They propose a multimodal cross-document event coreference resolution method that integrates visual and textual cues with a simple linear map between vision and language models. |
| Outcome: | The proposed method improves on a popular ECB+ and AIDA datasets. |